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Underutilization of 2 valuation findings relative to- 

‘the Comprehensive Employment and Training Act (CETA) legislation may - x 
not stem primarily from factors usually identified in the literature { 
(@,g., mathodological reasons) but may be superseded by a more potent 3 
factor such as the prominence of the policy or program on the 
national agenda. Viewed from an evaluator's perspective, strategies 
to increase use of evalation findings and barriers which may prevent ‘ 
such use are seen as having methodological or organizational roots.: : 
However, the slow but identifiable shift from decategorized to more 
categorized employment and training programs can be traced through 4 » , 

‘series of strong federal administrative initiatives that have altered 
the balance of power between federal, state, and local government 
delivery of employment and training activities. CETA, then, must be 
viewed as more than a training program. It is a part of national 
economic policy, and as such, responis to some of the ideas in good 
currency (e.g., high unemployment) which are then politically 
subsumed, under its rubric. Therefore, by looking at programs in 
relation’ to (1) their place on the national agenda and (2) the idjeas 
in good currency to which they relate, evaluators could more clearly 
focus evaluation questions in order to meet the needs of decision Ac 24: 
makers. Othef types of evaluation activity, such as economic and 
other outcome factors, will also have a better chance of having an 
impact on policy making because they more directly adress ideas in 
good currency. (MEK) : 
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FS ie r Re Be | Yo . , 
: _ncreasingiy, the ‘social apheneee are being called upon to access the. 


se 3 dant ra and‘ efficiency of social programs. Evaluation , requirements 


, vd 


hiss been incorporated into 9 la health, hoysing, community development, 


| evivinal justice, mental- heath and =e and ‘eens legislation. to 
a4 ' oo r 
name a few. Undergirding these anitatad is ‘the ass on that, evaluation 
will improve programs effectiveness by providing information to ‘improve decision- 
L ; i ** ee So 
making. 5, BSE 
However, is this assumption true? -It has been stulated that "utili¢ 


zation has been evaluation's weakest link." * (caris n, 1979:56) The liter- 


j 
e 


ature is replete with réasons behind the underutidjzation of evaluation findings. 
(for example see Patton, 1978; Steele, 1977; Guba} 1972; Hamilton + 
et al., 1977). They include ,the following: 
° Sinoe-grogran evaluation occurs in an a ion setting, many questions 
have been raised about the feasibility of using traditional research method- 


‘ology (i.e., experimefital design) . For example, Weiss (1970) asks: ‘If an 


Y 


employment and training program operates in area and the unemployment rate 
foiainiivin che same, what do we ria Or, to ¥ephrase the question, what evaluation 
information was obtained on which to Hana. reformulation of the program and the 
“paldcy? In addition, the general problem of securing control avo and ranhdom- 
P izing experiments, using human subjects,/has often been addressed feo. meee: 
1972). 
fe) Programs often have unclear and/or multiple objectives stressing in- 
dividualized sarotea Catibaks (Guttentag, 1973). For example, employment and 
o 


training programs implement a variety/-of activities and services covering a 


multitude of program objectives (e.g), reducing poverty, reducing unemployment, . 


<i 


increasing productivity of human resources) which’ may be competitive. This 


‘situation often leads ‘to .éonfusion when evaluators design’ objectives-based ‘ 
‘i . 


e i ry 


f evaluation studies. , 
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o The “imposition of, artificial and arbitraty restraints on the scope of 
a ‘N i 
a study 1 may lead to the neglect of other internation salient to the. ifplenen- 


“tation question (Hamilton et al., 1977). / This move toward defining study 


at 
- boundaries using ‘reductionism often results in myopic findings that faitito 
account for the interplay of factors that affect the ‘program or policy.’ n 
’ . 
-Public policies and programs, especially those in the human resources area, 


are aynante and complex. © Many actors and events critically impinge upon the, 
a direction by which thése policies and programs are formulated, invianentaads) 


evaluated, and “reformulated. While the reasons behind ‘the underutilization of 


evaluation findings cited above hamper mogt evaluation’ efforts, these concerns 


become more critical in the evaluation d implementation of large-scale social 


programs that are both diverse and Complex in their purpose and administration. 
. : f 
For example, many social scientists believe in rationality, i.e., the best 


knowledge available should be“used in the formulation of public policy. Weiss 
(1972: 33) stated: "when good theory and good data are placed at the service of 
policy makers, the subsequent decisions will be sounder and wiser." However, 

as Carlson (1979:56) said "programs administrators and service delivery staff 
cannot be expected to be ver rational; they are caught ina pressured situ- 
ation that demands Sen eee more than clarity velationahine; and connections 
more than effectiveness." This argument for incremental decision-making may be 
traced to Lindblom (1956) whereby partisan mutual adjustment beeaciae a principle 


ae method to reconcile competing differences through which public policy is for- 


mulated. The notion of incremental decision-making partially explains the most 
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recent ‘findings of Patton (1978) and 1 nikin (1979) where evaluation results 


were ‘perceived : as useful by evaluators’ and decision-makers: * In’ y Both cases, 


e ‘definition of ati lization’ was broadened, concentrating less, on the 


irect aapact on decision-making by expanding! the’ definition of utilization 


to. include the gradual influences on adninistrator perceptions of the evalu- : 


7 Bg . . tee L = 
ated Program. ‘ : : ’ ‘ : 
ty a ‘ ‘ ' . 
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_ Concern over the underuti lization’ of evaluation findings has led to the 


Ps 


‘identification ‘of strategies that may promote utilization of findings. For — 


example, alga et al. (4979) intkoduten an. analytic framework which | described 
the evaluation nd tiation and is deemed to have relevance for the understanding 
of utilization. Eight categories were identified: ‘(1) preexisting evaluation 


bounds, (2) orientation of the users, (3) evaluator's approach, (4) evaluator . 


- credibility, (5) organizational "factors, (6) extraorganizational factors, 


(7) information context and reporting, and (8) administrator style. Patton 


(1978:284) identified two basic satateeeanb tc a utilization-fecused 

approach to evaluation: ; 
First, relevant decision-makers and ‘emeunation users ‘must be 
Ndentified and organized--real, visible, specific and caring 

’ human beings, not ephemeral, general, and abstract ‘audiences', 
organizations, or.agencies.* Second, evaluators“must work 
activiw, reactively, and adaptively with these identified . 
decision-makers and information users to make all other decisions 
about the evaluation--decisions about research focus, design 
methods, analysis, interpretation, and dissemination. 


x 


These strategies are generally viewed from the evaluator's perspective as 


FScueand upon PeModolngerss and organizational concerns. The remainder of 


this paper waneks to look at the utilization of evaluation findings for. one 
specific piece of legislation--the Comprehensive Employment and Training Act 
of 1973 (CETA) as amended. In doing so, it will illustrate that the under- 


utilization of evaluation findings may not primarily stem from the factors 


«gg ‘a ‘ .° 


“usually identified in the literature (e.g., methodological reasons) but 


may be wuperseded by a more potent factor, i.e., the prominence of the 


ss 


policy or program on the national agenda. a; 


CETA--A Brief History. CETA was fha first in a series of spectal 


a ~< 


revenue sharing grants which transferred control: over a larger portion 


of ‘federal revenues to state and local jurisdictions (prime sponsors). for 
flexible use in lieu of a variety of categorical employment and training 


programs. Thus, CETA represented an attempt to alter a piecemeal system bi # 


+ 


Ro ° ws a 
, of employment and training programs by implementing two basic premises Litt 
undergirding anyeraOvarfmaeneat relations: 


, 


. 0 decentralization--local authorities know best local needs 
and how to respond to them; and, 


o decategorization--to deal effectively with those needs, 
maximum flexibility in the use of resources should replace 
the system of categorical programs. 
With CETA the basic’ frahework ee decentralized, decategorized 
employment and training delivery system was laid. However, since ihe in- 
ception of CETA in 1973, there appears to be a slow, buf Laentitiebte, 
shift from decategorized to more categorized employment and training programs. 
} 
Kruger and Curry (1978:46) suggest that: 
despite a surplus of fanfare and rhetoric, it is clear that 
Congress did not intend CETA to be a decategorized manpower 
program as many local officials would like to believe or 
were led to believe. In fact, there is evidence that both 
Congress and the Department of Labor have attempted to 
limit local flexibility to the greatest extent possible. 
Two recent examples reflect this trend. 
(1) The federal role as defined under CETA, includes the basic function 
of assuring prime sponsor compliance with the Act, reviewing prime sponsors' 


plans and assessing Program performance. In an effort to carry out these 


functions, the Department of Labor has taken a series of steps which give 


, - ee 
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it ‘increased power and control over prine sponsors. Tete steps includé 
more ‘stringent assessment of the prime sponsors’ “grant case eat 
the development of national performance ‘standards such as ailered emp loy- - 
merit aeed, and indirect Placement rates “treugbr an sri Cue 1978; National —. 
Gaunlbwien foe tanpows Policy, 1976). a 2 “ep a en a 

Program performance indicators are generally considered to be a move 
towards natiénally established ‘program cavieiehane standards, . The estab- 
lishment of national performance standards, in turn, often Rd tiated to 
lead to eventual control ies the mix of employment ied training services 
prime sponsors choose. The National Council on Husiovaant periigy has stated 
that "centralized performance goals run deunter to the spirit of the CETA. 
Individual prime sponsors and inte ‘programs are as unalike as apples ac 


oranges; attempting to apply a single standard to them denies local ini- 


tiatives" (Kruger and Curry, 1978:46). 
(2) A second example of the erosion of block grant flexibility comes l 
from recent legislative avian by the Congress. Originally, Congress was | 
reluctant to have the: public service employment- program become one of the 
Alowibte activities dndiat Title I. Asa result, Title II was authorized / 
ana funded for this purpose. In vbwponte to the increasing sig dhcoes | 
rate and the economic recession, Congress added a new Title " (the Emer- 
~ gency Jobs and Unemployment Assistance Act) to CETA in 1974, which was thins 
extended. Most recently Congress has added several specific youth programs 
to CETA by expanding Title III and adding Title VIII (Kruger and Curry, 1978; 
National ‘Commission for Manpower euiley: 1976): as well as several targeted 


programs such as the Private Sector Initiatives Program (PSIP) and Skill 


Training Initiatives Program (STIP). 


sss 5 


Although these enactments include some features of the block grant 


approach, they 


. 


clearly illustrate that Congress’ harbors ‘second thoughts 
on the authorization of block grants, generally ‘and CETA 
specifically. The Congressional tendency "to give flexi- : ‘ 
bility and then to withdraw that same ° flexibility over Lae 
__ time can be clearly observed. In fact, the Congress is ei. | * 
‘now beginning to administer the public employmerit program at ; 
’, through legislation. The .°.'. Emergency Jobs Program 
i Extension Act ‘goes so far as to establish. specific criteria . 
’ for determining participant eligibility for the jobs” funded : ” 

under Title VI. ‘The prime sponsor's option. ‘to determine a - 

whom among the unemployed is to be served with this por- . 

’ tion of the funds has been eliminated. In additior, the 

prime sponsors’ program planning flexibility--never any- =~ i% 
thing to brag about in the public employment program-- : 
has been further eroded. The purposes for which the money 

- is to be spent, and in what time frame are specific and 

are dictated from the banks of the Potomac. The prime. . : 

sponsor is a project director administering a federal ~~ Pe 

program through designated program agents (National ; a 

Commission for Manpower Policy, 1976:211). 


Thus, these two actions add to the uncertainties surrounding the intent, of 
CETA and the future role of decentbalized [fone serene and 
training programs. ” 

“ In addition, the erosion of flexibility may be traced nasi x series 
of federal administrative initiatives that have gikecaa the balance of power 
between the federal, state, and local governments delivery employment and 
training activities. Snedeker and Snedeker (1978) cite ths following exam- 
ples’ | | | 
1. The increasing pressure on prime sponsors to use the employment % 

service for placement, and the inckeaning pressure to service .) 

WIN, federal aiipplenental benefits recipients, and Trade Re- 

cadauene Act benef tiaries. 


2. .The increased efforts from the national office to link the t 


employment services ‘and CETA in order to deal with some service 


- duplication (e.g., “intake, referral, job development). - 


. 
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3. The Scacaaling? ata of administrative guldedines from the 
| national and cegional offices. call ae 
‘4, The increased influence of regional officgs as grant review 
guidelines — more detailed, federal anhual pet formance, Y. . _s. ‘ 
davevinente woes eavlaie, and the required ‘potential grant 
modifications more fréGuent. | is 3 | + . : ! a 
5. The ational vee¥crmance standards threatened prime sponsors 7 i. 
programming flexibility and the eae oe some prime _ i 
sponsors to rationalize short-term, quick-placement programs } Ps! . . i. 
shite focusing little attention to employability development. . 
Local flexibility was also threatened. by national office ef- 
forts such as the 1976 witcime to limit work experience to aha 
ninety-day enrollment. -_ by 


‘ 


6. The enforcement of a sition formula for pubite service mepsovess tus 


* The prohibition of planning council members representing sub- F 


~ 
- 


~ 


grantees or community-based groups from participating in dis- 


cussions on service issues. 
é , The examples cited above illustrate the beginning of a movement in the 
delivery of employment and training activities from decentralized, decate- 
gorized service delivery, toward efforts to categorize employment and train- 
ing services. Together they identify strains in the relationship between 
federal, state, and local governments as they vie for more control over the 
delivery of employment and.training services. Snedeker and Snedeker (1979: | 

259-260) illustrate some of these strains: 

Two years into the era of decentralization and decategorization, 

it was apparent that many were having second thoughts. “Chief 

among then was Congress for whom local decision-making was an. 

abnormal and uncomfortable way of doing the public's business. 

Decentralization and decategorization offer Congress neither ‘ 


power nor recognition, whereas established programs directed 
from Washington provided both. And CETA proved to have a low 


¥ 


- level of national wisinttity. Because the programs are Adie 

~ active only within local communities, the general public does not 
em to identify CETA activities with the federal government. 
al elected officials, rather than members of Congress, are @ 
nerally given the credit for program success. Since Congress me 2 
gs still responsible for overall accountability, complaints of 
disgruntled clients“or/ would-be clients end up in their’ offices. 
_ | Reports. of program abuses or malfunctions result ‘in particularly 
/, intense concern by Congress. The prospect of being blamed for 
| program failures, coupled with a lack of knowledge or identifi- 
' cation with positive program results, push embers of Congress 
toward tighter federal COnErehs 


CETA, then; must be whawad in a broader framework for it is more than 
; es . : 


olely 3 training program. This may be illustrated by the distribution of 
CETA program funds. Beyond heing a training program, CETA represents: 


a a continuation of a commitment to assisting the nation's - 
unemployed through federal programming; 


2. .a component of national macroeconomic policy; 


3. an example of intergovermental relationships whereby an 
overlapping framework emerged between multiple levels of 
governments to deliver services to ‘specific cee popu- 
lations; , 


4, a\shift in programming from fragmentation and duplication 
as\a result of categorical programs to coordinated pro- 
gramming under a block grant approach; ‘and, 


5. an alteration of tke balance of power from functional spe- 


cialists operating pre-CETA programs to elected authorities 
(e. 9. , MAYORS. governors) . 


Ideas in Good Currency. rdeaa in good currency such as the "Space, Race" 
of the sixties and the "Law and Order" mereeans of the late sixties and early 
seventies "are ideas powerful for the formation of public policy. Among 
their most chavacteristic features are these: They change over time; they 
obey a law of limited number ; and; they lag eekand changing events. 


hacker ’ “1971: 123-124). 
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' Milward (1979:11) states that’ "new ideas in good currency usually | 
emerge from a disruptive event or a series of events. These perceived 
crisis set up a demand in/ society for. new ‘ideas to solve these premiere: 


Not. all ideas in good currency reach the pegtalateys agenda and oar 


programs. Many ideas are "slow to come "ink6 good currency... and, 


by the time ideas have come into goss currency they often no longer accu=, 
ay 
rately reflect the state of affairs." (Schon, 1971:127). _Aiso, thes 


pressure of ie sees ideas for both public , ackantton pe evatiable re- 


sources often’ limits ‘the transition of the jaeas into’ programs. the 


TeRerHaee of this section’ traces the emergence, of Suployment and. ‘tvaln= 


ing policy as it has been auacciatea with one, or several, inane in ‘aoed 


’ ne ome F ; \ 
‘ - P \ ) 
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Employment . and training eek by and large has represented a 
reactid to the economic and political climates existing at ene time. 


For example, during the Depression, the response to massive Sntecioraak™ 


resulted in a shift in responsibility ‘from. public assistance to the federal ° 


government through such programs as the Civilian Conservation Corps and 

the Works Project Adnirfistration. with the termination of World wie a 
concern arose again over the sowie of massive unemployment; hence is 
the Employment Act of 1946 was enacted. During the early sixties, atten- 


tion was focused on stimulating economic growth in areas of high unemploy- 


. ment (Area fiedeve lopment Act). President Kennedy later Breeeneyy a more 


simpiwhatinlive Program to ali a ah ‘Development and Training Act 
(MDTA) --which marked the beginning of an effort to tackle human resource 


problems by authorizing and implementing categorical programs aimed at 
my) ; 


providing education and training opportunities for the unemployed. 


Poverty legislation continued this thrust by broadening the spectrum of 
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new categoricil prograns. The Beondnie opportunity’ AGE dh a its 


funds to ‘the pia aaatink disadvantaged through piteicts categorical 
programs (e.g., Job Goris; melacnogd aie8 Corps, Operation Main- eee 
stream). Beginning in 1973, the Nixon, administration began a wholesale _ me 
oe ppeectton of the Great’ Society prograns. me ‘fragmentation and ‘dupli- . e Pa 
cation of service delivery led to the implementation of somite RE ty i » i 
initiatives like the Comprehensive Manpower, Program in an effort” to | * oS eee 
operationalize the concept of revenue sharing. In 1973, the final . i he ~ 
step toward decentralization of enploynerit and training predeaie al ‘ Le 
taken with the passage of CETA. However dave peak after its -passage, | 


increasing unemployment rates s provided the impetus for samending CETA to - 


‘include a public service employment prgssaa (Title VI). . Subsequent rises ‘ eh. 

in the sino ieiaine rates of eee and mines eity’ youth, in particular 2 wt ci zs 

gave rise to the addition of new youth programs. other target programe | " a ee ; 

have also been funded such as the Private Section tated atdieba Program (ese) i : eae 
ee ; 


and the-Skill smanins Initiatives Program. (stIP) . * 


e \ 


Evaluating Ideas in Good Currency. The evaluation of CETA efforts to 


date have been relatively sparce. ‘ Perry et al. (1976) published. a sautee : 


of over 200 pre-CETA studies (most of inten: were unpublished government _ 

reports or private foundation reports) primarily studying a. single economic 

outcome (e.g., change in hourly earnings, change in employment history). : 

the CETA evaluation ieeeahiee is predominantly descriptive focusing on the 
{ . 

trandftion from categorical Programs to.CETA (e.g., Mirengoff and Rindler, 

ik ACIR, 1977) 5 the implementation of CETA by prime Sponsors (e.g., Siglo: 


1977, 1978); single case studies of specific prime sponser organizations 


(e.g., Kobrak, Bee policy issues (e.g., National Gonwdnaken for Manpower 


Policy, 197575 1978); and exemplary programs le Je, featured programs in 


‘tn fature such! as tracking actual versus planned Partormange on.a quartaxiy 


. ig : basis and follow-up studies of former curt iclbante, : é . 8 
ee ae Spy and large, these eve uation efforts focus on. _Ampréving the imple- a 
: ~s : enntatide of a portion of em Loyinent and training ren as funded under 


¥v y 
delivery modes by prime sponsors, usually, 


ee “CETA. _ Major changes an servi 
are’ divencty connected to legis ative and Administrative initiatives on 


N ° 


: : ae “the national level. That is, tH 7 addition of new Programs or broadening et, 3 
: Ue . of service to specific vaxgee groups~ offten- result from additional funding’ 4 ie . 
received through je titles or responses to nationally Gavititins requests 
» for proposals. These ‘ei ae main changes; in turn, may be viewed ‘as emerging 
oem, ideas in a currency. As previously argued, CETA is more: than a 


my: 


training program, It is a part of national economic policy and, as auch, 7 


° / a ee 
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responds to some of the ideas in good currency .(e.g., high unemployemnt) 
-: subsumed under the nbeie It is also ‘an example of intergovernmental 
relations in action. As such, CETA is a vehicle and not an end in itself. 
Halperin (1979:28) dicua ths same distinction for education. He stated . 
_seethe 'Feds' utilize education inatitutions to pursue more = 
specific goals...In other words, education’ may be the mode 
ae baits of delivery but it is not the major organizing concept for, 
or the primary intended beneficiary of, federal programs. 
this netics of looking at programs in light of their ‘position Pow 
national agenda is central to the dasiton of evaluations and the degree .of 
utilization of. evaluation findings. It ‘sacneiie more eeoutane when the pro« 
gram being evaluated is in peepee to an idea in good currency Saininet ‘ 
o Ideas in yood ouryency. may be placed on a temporal continuum, On 


' one end are those ideas that at one time were in good currency but have : 
JZ since waned. Current eaeas in good currenty occupy the opposite end of the 


continuum. ’ For example, once an idea in good currency is translated into a ; 
U ely = a a oI a 
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Ng 
policy, programs are created to administer them. Milward (1979:11) . 


illustrates this point with Veterans Affairs offices which sdninieter 

services and benefits based upon the existence of universal conscription-- 

a ‘cage of an idea in good currency whose time.ended with the iepTenantation 

of a: voluntecr army but which continues to be preserved by interest aucune oyu s 

cendeatiad by Worl War II veterans. On the other end of the continuum are 

those ideas’ that’ consistently remain in good currency ‘ (although the degree 

of publib: attention may fluctuate aus to other crises). ‘Ideas aimed at im- 

proving the chepation of the economy fall into ‘eas ‘latter: eaceqonyr ‘and, “oe oi (eat 
0 Policies (and their resultant a may be tied to more’ than Me | 

one idea in good COREAIEN In eee cases the ideas provide ‘aifferent 

Mine of designing the evaluation eed For example, Farley (1979) 

-identified over 250 different outcomes of vocational education that appear 

in the literature. Which outcome or outcomes are the most important and 

thus should be evaluated? The idunieeewetas of the specific ideas in good 

, currency to the policy is tied will aid in focusing the evaluation questions. 2 
The point. to be made is that policies (and their resultant programs) - 

should not all be aianceae in the same way. While few would argue that 

evaluation information should be an important input into the formulation, 

implementation, and reformulation of policies, other factors, will often 

supersede. “this is seated true when the policy addresses an idea 

currently in good currency where political factors will (and should) play 

a prominent role in policy making. However, by looking at or in / 

Yelation to (1) their place on the national agenda, and “(2) the ideas in 


good currency to which they relate, evaluators could more plsstiy. for 


evaluation questions in Order to meet the needs of decision-makers. 


a9 - oS 
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However, evaluation activities may be conducted for other reasons _. 


~ that are just as valid as having an impact on policy making such as 


program improvement. In fact, it appears that evaluation payoff is 

probably eee TAS situations where ‘the findings avi geared toward 
more Spara Cipacpetene decision-making (Wholey,, 1972; Weeks, 4979). in 
these cases, evaluation findings may serve as a tool to lesiees the ef-. | 


fectiveness of the programs as they are in operation, or in-other words, 


to improve the implementation of the policy. CETA provides a good ae 


. of this distinction. Prime sponsor, evaluation efforts: hand the 


majority of the CETA literature for that matter) fall into a tattex | 
category of program Kaci In general, they describe the program 
ispiomantation process and aay ery eer Studies which focus on 
economic and other outcomes sneceks Sach: as Baumer et at (1979) and ’ 
Borus (1978) will have a better chance on having an er on policy ailiea 
see they more directly Sires ideas in good .currency. Nocaticaat edu-~ 
cation also illustrates this distinction. For example, separa projects at 


the National Center for Research in Vocational Education focus upon program 


improvement such as identifying patterns of state leadership and teaching 


‘the uses of different evaluation strategies to state and logal persons while 


others focus upon outcomes (e.g., McKinney, 1978; Darcy, 1979). : 
In sum, each type of evaluation effort serves an important purpose. 


Often they work in tandem for "the formation of policy cannot be neatly 


_ separated from its implementation" (Schon, 1971:161). While ideas fore- 


t 
most on the national agenda are the ones often translated into policy. 


The opportunity for learning is primarily in discovered systems 
at the periphery, not in the nexus of official policies at the 
center...movement of learning is as much'from~periphery to peri- 
phery, or from periphery to center as al ‘center to periphery. 
(Schon, 1971:177). 


1% 


: J 
: question of increasing the utilization of evaluation findings geared toward 


SA i K , rc . ’ P 


The aise government , thus, cannot. serve the role of the local service 


-deliverer. It specifies the broad outline’ ‘of the desired policy and asks 


local service deliverers to fili in the BLES through their program designs. 


Evaluation efforts. have a real opportunity to ees a role in enhancing this 


learfing process. - However, improving methodologies or solely meeting the 


needs of immediate decision makers is not enough for it only addresses the 


_ program improvement. However, on. the policy level, cetrtfal to the “utdliza~ 


programs, are dynamic and a Congress authorizes few programs that j 


j ‘y 
tion issue ge: the Pharose, Of | these programs, i.e., are they a vehicle foi 


; f 
ieanonaine to an idea in “good TURSENCY or an end in themselves? Social 


ve 


are not tied to one. or several idéas that are of active *concern to the 


4 


public. Programs should be mapped backward to the policies and issues 
from which they are derived. “In this way, evaluators should be pat 
able to derive more salient evaluation questions that meet ‘the -underlying 


information needs of policy makers. e ¢ * 
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